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INTRODUCTION 


There  are  several  remote  unmanned  submersibles  which 
are  under  development  or  have  been  proposed.  They  all 
require  manual  vehicle  control  while  simultaneously 
requiring  operator  control  or  attention  to  other  tasks 
such  as  operating  the  search  sonar,  grabber,  manipulator, 
etc.  It  became  apparent  that  if  voice  control  over  the 
movement  of  these  vehicles  could  be  accomplished,  the 
operator  would  have  greater  freedom  to  concentrate  efforts 
on  the  more  demanding  tasks  requiring  immediate  attention. 

The  remote  unmanned  submersible  selected  for  voice 
control  implementation  was  the  Fiber  Optic  Controlled 
Underwater  Stereo  (FOCUS)  vehicle.  This  vehicle  was 
selected  because  of  its  availability  and  its  ongoing 
development.  Figure  1  shows  a  block  diagram  of  the  voice 
control  FOCUS  system. 


BACKGROUND 

The  FOCUS  vehicle  (see  figure  2)  is  a  remote  unmanned 
submersible  which  is  controlled  over  a  single  fiber  optic 
cable.  The  fiber  optic  cable  carries  all  of  the  instrumenta¬ 
tion  and  control  signals  required  to  operate  and  monitor  the 
vehicle.  The  vehicle  carries  two  T.V.  cameras,  giving  it  a 
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Figure  1.  Voice  Control  Block  Diagram. 


stereo  viewing  capability,  and  a  scanning  obstacle  avoidance 
sonar  for  navigation  and  search.  Propulsion  is  furnished  by 
two  horizontal  and  one  vertical  thruster.  The  power  required 
to  operate  the  vehicle  is  furnished  by  eight  lead-acid  batteries 
which  are  housed  in  four  pressure  housings. 

OBJECTIVE 

The  objective  of  this  project  is  to  demonstrate  the 
advantages  of  voice  control  on  a  remote  controlled  submersible 
and  show  its  feasibility. 

APPROACH 

The  FOCUS  vehicle  requires  three  input  command  channels. 
The  commands  control:  (a)  Speed  (forward,  reverse) ,  (b)  Turn 

(left,  right),  and  (c)  Vertical  (up,  down). 

An  Apple  II  computer  with  a  speech  recognition  peripheral 
was  purchased  to  be  the  voice  recognition  control  system.  A 
computer  to  fiber  optic  telemetry  interface  circuit  (see  figure 
3)  was  designed  and  fabricated  on  an  Apple  computer  hobby 
board  for  installation  in  the  computer. 

The  computer  (see  figure  4)  recognizes  the  command  and 
speed,  then  outputs  signals  to  the  respective  thrusters 
through  the  interface  circuit.  The  software  (see  Appendix  A) 
has  been  developed  to  interface  with  the  speech  recognition 


Figure  4.  Computer  and  Control  Console. 
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peripheral  to  which  control  is  passed  when  commands  are 
input.  The  peripheral  has  two  modes  of  operation:  (1)  a 
training  mode  in  which  examples  of  each  word  are  provided; 
and,  (2)  a  recognition  mode  in  which  previously  trained 
words  are  recognized.  The  peripheral  executes  its  own 
program,  which  is  independent  and  unchangeable,  to  determine 
which  of  the  previously  trained  words  were  spoken.  It  then 
outputs  the  recognized  word  and  returns  the  control  to  the 
original  program.  Three  commands,  direction,  speed,  and 
execute  are  entered  sequentially  in  the  program.  The  direction 
command  must  be  recognized  before  a  speed  command  can  be 
entered  and  the  speed  command  must  be  recognized  before  the 
execute  commands  can  be  entered.  The  direction  commands 
used  are:  AHEAD,  BACK,  PORT,  STARBOARD,  UP,  DOWN,  and  ALL 
STOP.  The  speed  commands  are:  ONE/THIRD,  TOO/THIRDS,  FULL 
and  ZERO.  The  execute  commands  are  GO  (for  execute)  and 
IGNORE.  IGNORE  will  cancel  all  previous  inputs. 

CONCLUSION 

The  testing  done  with  voice  control  on  the  FOCUS  vehicle 
demonstrated  the  feasibility  of  voice  control  on  remote  unmanned 
submers ibles .  Due  to  the  late  start  of  the  program,  extensive 
operator  tests  were  not  run.  However,  the  subjective  responses 


APPENDIX  A 

VOICE  CONTROL  SOFTWARE 
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Poke  74,  124:  Poke  204,  124:  Poke  75,  21:  Poke  205,  21. 

REM  Set  Lomen:  5500  for  speechlab  program 

Call  -936:  dim  8$  (15,  FA  (3),  FB  (3),  FC  (3) 

Print:  Print  "TO  CONTROL  THE  FOCUS  VEHICLE,":  Print: 
Print  "THE  OPERATOR  MUST  GIVE  A  COMMAND," 

Print:  Print  "SPEED,  and  EXECUTION.  The  command": 
Print:  Print  "AND  SPEED  ARE  PRINTED  OUT  FOR  YOUR" 


50  Print:  Print  "CONVENIENCE.  If  the  Command  or":  Print: 
Print  "SPEED  PRINT  OUT  IS  INCORRECT," 

60  Print:  Print  "USE  'IGNORE'  to  delete  the  command.": 
Print:  Print  "IF  THE  COMMAND  AND  SPEED  ARE  CORRECT," 


70 


Print:  Print  "EXECUTE  WITH  'GO'  STATEMENT.":  Print: 
Print 


80 

90 

95 

100 

105 

110 

115 

120 

125 

130 

135 

140 

145 

160 

170 


Input  "TYPE  "GO'  to  begin  voice  control  program.",  8$ 

Slot  1-3:  REM  speechlab  slot 

Slot  2  -  -16160:  REM  Focus  Address 

FA  =  0:  REM  ahead/back  flag 

FB  =  0:  REM  port/starboard  flag 

FC  =  0:  REM  down/up  flag 

FI  =  128 : REM  halt  (1000)  (0VDC) 

F2  =  255 : REM  neq  full  (1111)  ( 5VDC)  (235  approx  -  4VDC ) 

F3  =  192: REM  neg  half  (1100)  ( 2VDC ) 

F4  =  144: REM  neg  slow  (1001)  ( . 9VDC) 

F5  =  1:  REM  plus  full  (0000)  ( 5VDC )  (20  approx  4VDC ) 

F6  =  64:  REM  plus  half  (0100)  ( 2VDC ) 

F7  =  106 : REM  plus  slow  (0110)  ( . 9VDC ) 

DIM  C$  (15),  W$  (15),  A  (3),  B  (3),  C  (3) 

Gosub  9000:  REM  init  speechlab 
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Call  -'336:  Print  "THIS  IS  A  PROGRAM  TO  CONTROL":  Print: 
Print  “ -HE  FOCUS  VEHICLE  BY  VOICE  COMMANDS." 

Print:  Print  "COMMANDS  ARE:  AHEAD-BACK-STARBOARD":  Print 
Print  "PORT-'UP-DOWN- ALLSTOP  .  " 

Print:  Print  "Speeds  are:  ONE/THIRD,  TOO/THIRDS " :  Print: 
Print  "FULL-ZERO.":  Print:  Print  "FIRST,  WE  TRAIN  THE 
SYSTEM.":  Print:  Print 

Input  "Type  'GO'  to  start  the  program:"  W$ 

For  I  -  1  to  2 

W$  =  "ALL  STOP":  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  "GO":  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  IGNORE":  Print  "SAY:";  W$"  GOSUB  9100 
W$  =  "BACK":  Print  "SAY:";  W$:  GOSUB  9100 
W$  -  "STARBOARD":  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  "PORT":  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  "UP":  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  "DOWN”:  Print  "SAY:";  W$ :  GOSUB  9100 
W$  =  "ONE/THIRD":  Print  "SAY:";  W$  :  GOSUB  9100 


ws  = 

"TWO/THIRDS"  : 

Print 

"SAY: 

";  W$: 

GOSUB 

w$  = 

"FULL":  Print 

"SAY: " 

;  W$: 

GOSUB 

9100 

ws  = 

"ZERO":  Print 

"SAY: " 

;  W$: 

GOSUB 

9100 

NEXT  I 

Call  -936:  Print:  Print  "THE  SYSTEM  IS  NOW  READY." 

Print:  Print  "THE  FOCUS  VEHICLE  WILL  NOW  OBEY":  Print: 
Print  "YOUR  COMMANDS.":  Print:  Print 

Input  "TYPE  'GO'  to  begin  operation.",  W$ 

GR:  color  =  15 

Call  -936:  Print  "COMMAND  PLEASE":  GOSUB  9200:  REM  get 
a  command 
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410  C$  =  W$:  A=FA:  B=FB :  C=FC 
420  Call  -936:  Print  C$ 

430  If  W$  =  "ALL  STOP"  then  9250 
440  A1  =  Slot  2 
450  If  W$  =  "AHEAD"  then  600 
460  If  W$  =  "BACK"  then  610 
470  A1  =  Slot  2+1: 

480  If  W$  =  "STARBOARD"  then  630 
490  If  W$  -  " PORTP  then  620 
500  A1  =  Slot  2+2: 

510  If  W$  =  "UP"  then  650 

520  If  W$  =  "DOWN"  then  640 

530  Print:  Print  "DID  NOT  UNDERSTAND  YOU 

540  For  I  =  1  to  300:  NEXT  I 

550  GOTO  400 

600  FA  =  1:  GOTO  9300 

610  FA  =  -1:  GOTO  9400 

620  FB  =  1:  GOTO  9300 

630  FB  =  -1:  GOTO  9400 

640  FC  =  1:  GOTO  9300 

650  FC  =  -1:  GOTO  9400 


I 

k- 

» 

•  - 

s 

I 


700 

GR: 

Color  =  15 

710 

If 

FA 

= 

1  Then  9600 

720 

If 

FA 

= 

-1  Then  9610 

730 

If 

FB 

= 

1  Then  9630 

740 

If 

FB 

= 

-1  Then  9620 

750 

If 

FC 

= 

1  Then  9650 

760 

If 

FC 

= 

-1  Then  9640 

770 

GOTO  - 

400 

9000 

9010 

9100 

9110 


REM  init  speechlab 

PR#S lot  1:  Print:  PR  #0:  RETURN 

REM  Train  Routine:  ARG  =  W$ 

PR#  Slot  1:  Print  W$:PR#0:  RETURN 


9200 

9210 

9220 

9250 

9260 

9270 

9280 


REM  recognize  routine 
In  #Slot  1:  Input  W$ 

PR  #0:  In  #0:  RETURN 

POKE  SLOT  2,  FI:  Poke  slot  2+1,  FI:  Poke  slot  2+2,  Fl: 
GR:  color  =  15:  HLIN  4,  6  at  5:  VLIN  4,  6  it  5 

FA  =0:  FB  =  0:  FC  =  0 

Print  Slot  2,  Slot  2+1,  Slot  2+2:  Print  Fl,  Fl,  Fl: 
For  I  =  1  to  200:  NEXT  I 

GOTO  400 


9300 

9305 

9310 


REM  Plus  speed  routine 
Call  -936:  Print  C$ 

Print:  Print  "SPEED  PLEASE":  GOSUB  9200 
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5 


I 


t 


9315 

9320 

9325 

9330 

9335 

9340 

9345 

9350 

9355 

9360 

9365 

9400 

9405 

9410 

9415 

9420 

9425 

9430 

9435 

9440 

9445 

9450 

9455 

9460 

9465 


If  W$  =  "IGNORE"  then  9560 
Dl  =  F7 

If  W$  =  "ONE/THIRD"  then  9500 
Dl  =  F6 

If  W$  =  "TWO/THIRDS"  then  9500 
Dl  =  F5 

If  W$  =  "FULL"  then  9500 
Dl  =  FI 

If  W$  =  "ZERO"  then  9570 

Print:  Print:  Print  "SPEED  UNKNOWN":  For  I 
Next  I 

GOTO  9300 

REM  Neg  Speed  routine 
Call  -936:  Print  C$ 

Print:  Print  "SPEED  PLEASE":  GOSUB  9200 
If  W$  =  "IGNORE"  then  9560 
Dl  =  F4 

If  W$  =  "ONE/THIRD"  then  9500 
Dl  =  F3 

If  W$  =  "TWO/THIRDS"  then  9500 
Dl  =  F2 

If  W$  =  "FULL"  then  9500 
Dl  =  FI 

If  W$  =  "ZERO"  then  9570 

Print:  Print:  Print  "SPEED  UNKNOWN":  For  I 
Next  I 

GOTO  9400 


1  to  300 


1  to  300 


L4 


9500  Z$  =  W$ 

9505  Call  -936:  Print  C$ ,  Z$ 

9510  GOSUB  9200:  REM  get  execution  statement 
9520  If  W$  =  "IGNORE"  then  9560 
9530  If  W$  =  "GO"  then  9550 

9540  Print:  Print:  Print  "ILLEGAL  STATEMENT":  For  I  =  1  to  300 
Next  I 

9545  GOTO  9505 

9550  Print:  Print  "COMMAND  ACCEPTED":  Print  Al,  Dl:  For  I  = 

1  to  200:  Next  I:  Poke  Al,  Dl 

9555  GOTO  700 

9560  Print:  Print:  Print  "COMMAND  IGNORED":  For  I  =  1  to  300: 
Next  I 

9565  FA  =  A:  FB  =  B:  FC  =  C:  GOTO  700 

9570  If  C$  =  "AHEAD"  then  9700 

9575  If  C$  =  "BACK"  then  9700 

9580  If  C$  =  "STARBOARD"  then  9710 

9585  If  CS  =  "PORT"  then  9710 

9590  If  C$  =  "UP"  then  9720 

9595  If  C$  -  "DOWN"  then  9720 

9600  VLIN  1,  7  at  5:  HLIN  4,  6  at  2:  Plot  3,  3:  Plot  7,  3: 

Plot  2,  4:  Plot  8,  4:  GOTO  730 

9610  VLIN  9,  15  at  5:  HLIN  4,  6  at  14:  Plot  3,  13:  Plot  7,  13: 
Plot  2,  12:  Plot  8,  12:  GOTO  730 

9620  HLIN  5,  10  at  8:  VLIN  7,  9  at  9:  Plot  8,  6:  Plot  8,  10: 
Plot  7,  5:  Plot  7,  11:  GOTO  750 

9630  HLIN  0,  5  at  8:  VLIN  7,  9  at  1:  Plot  2,  6:  Plot  2,  10: 
Plot  3,  5:  Plot  3,  11:  GOTO  750 
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9640 

VLIN 

35, 

39  at 

2:  VLIN 

35, 

39 

at 

4 : 

Plot 

3, 

39: 

GOTO  400 

9650 

VLIN 

39: 

35, 

GOTO 

39  at 
400 

4:  VLIN 

37, 

39 

at 

2: 

Plot 

3, 

37: 

Plot  3, 

9700 

FA  = 

0: 

GOTO 

9500 

9710 

FB  = 

0: 

GOTO 

9500 

9720 

FC  = 

0: 

GOTO 

9500 

